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The teacher's role in documenting behavioral programs 
on individual education plan objectives for behaviorally disordered 
(BD) students is discussed, anc$ assessment instruments are presented 
and reviewed. Student behavioral monitoring is examined using 
pre/post testing with standardized instruments, product measures that 
indicate progress or outcomes, and student materials and process 
records from student files. After discussing behavior rating scales, 
self-rating instruments, and sociometric devices (i.e., standardized 
pre/post measures), the following examples are presented, along with 
general descriptions, score interpretations, authors, source, and 
data: Devereux Elementary School Behavior Rating Scale, Behavior 
Rating Prof ile , Piers-Harris Children's Self-Concept Scale, 
Nowicki-Strickland Locus of Control sicale for Children, Behavior 
Rating Profile Sociogram, The Class Pictures, A Class Play, and 
Student Survey. Examples and information are also presented on 
criterion referenced procedures , analogue (simulation ) observations , 
and archival records (i.e., product measurement procedures). Specific 
instruments are: VORT Behavioral Character istics Progression 
(suggested as a reasonable solution to the problems of sequencing, 
providing standards and document iftg change ) and Goal Attainment 
Scaling. Graphing of class attendance data and the use of a behavior 
card file are illustrated. Finally, the following examples are 
presented to illustrate process /measurements based on point systems: 
frequency counts, token economy / system data (students receive tokens 
to be cashed in for privileges)/, self -monitor ing procedures, Walker 
Classroom Observation System,. and Madsen and Madsen Code with Walter 
Alternating Peer System. Six steps for making systematic classroom 
observations are also identified. (SEW) 
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This monograph is designed to provide teachers 
and administrators with information on behaviorally 
disordered students. It is one of a series of seven. 
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1. Myths, of Behavioral Disorders 

2. Developing a School Program for Behaviorally 
Disordered Students 

3. Establishing a Program for Behaviorally 
Disordered Students: Alternatives to Consider, 
Components to Include and Strategies for 
Building Support 

4. Reintegrating Behaviorally Disordered Students 
Into General Education Classrooms 

5. Positive Approaches to Behavior Management 

6. Practical Approaches for Documenting Behavioral 
Progress of Behaviorally Disordered Students 

7. Excerpts from: Disciplinary Exclusion of 
Seriously Emotionally Disturbed Children from 
Public Schools 



0 



ERLC 



i 



J 



Table of Contents 

Pa^e 



The Teacher's Role in Documenting Behavioral Progress 1. 

Planning a Data Collection System . . . 2 

Implementing the Plan Systematically 3 

Pre/Post Measures 4 

1. Behavior Rating Scales' 8 

2. Self-Rating Instrument 18 

3. Sociometric Instruments. . . . ; 20 

Product Measures. . . . . 24 

1 . Criterion-Referenced Procedures 25 

2. Analogue Observation 39 

3. Archival Records 45 

Process Measures 49 

1. Point System Procedures 52 

2. Systematic Observation Procedures 69 

Bib! iography . 82 



ERIC 



PRACTICAL APPROACHES FOR DOCUMENTING 
BEHAVIORAL PROGRESS OF BEHAVIORALLY DISORDERED STUDENTS 

Gail E. Fitzgerald 
Director, Department of Educational Services 
Child Psychiatry Service 
University of Iowa Hospitals and Clinics 

Lecturer, Division of Special Education 
University of Iowa, College of Education 

The Teacher's Role in Documenting Behavioral Progress 

Planning and evaluating individual objectives for students are 
two major legal and ethical responsibilities all special educators have. 
Whereas, many areas of special education focus objectives primarily on 
learning skills and academic achievement, teachers in the field of 
behavioral disorders (BD) must deal directly with behavior improvement 
and emotional adjustment. Writing objectives and evaluating progress 
in tiiese areas are obviously more difficult tasks, and teachers generally 
have less experience and resources in doing so. 

This chapter presents a number of practical methods BD teachers 
can use in documenting progress on individual education plan (IEP) 
objectives; they are quite reasonable in their time demands and provide 
accurate child change data. The approaches should appeal to teachers 
because they really seem to work in showing* what' s happening with 
students. They have not been selected either because they do or do not 
meet research standards for reliability and validity, but rather because 
they can provide representative information over a period of time. 
Even though the BD teacher's role is not to be a measurement technician, 
he/she can greatly improve the quality of progress data gathered by 
using objective criteria, planning a data collection system, and then 
systematically implementing it. 

-1- 

ERLC i 



Planning a Data Collection System 

Objectives in social and emotional change areas are often not 
written because they are difficult to specify and measure. It is 
difficult to be precise when describing ways to influence and measure 
changes in areas such as self-esteem, self-control, and feelings. 
Instead of trying to develop measurable objectives in these areas, 
teachers should try to think of related behaviors which indicate change. 
When such change indicators are described in a sufficiently clear manner 
so two or more persons can agree on their outcome, the indicators can 
be used in objectives as bench marks or standards. 

Once objectives are determined fo.* each student, the teacher needs 
to identify the types of information he/she can gather which will provide 
feedback on progress. Each objective should have some form of clear- 
criteria for gauging improvement. It will help to build into the class 
data collection plan as much uniformity as possible to reduce the number 
of individual measurements which need to be implemented. 

It makes sense for BD teachers to model the procedures used in 
general education when setting up a plan to document behavioral/affective 
improvement. Progress in general education is typically documented by: 

• 1. ' annual achievement testing; 1 

2. results of criterion-referenced or teacher-made tests, and 

3. student materials gathered in a teacher file. 

Similarly, the BD teacher can establish an efficient data recording 
system which includes: 

1. pre/post testing with standardized instruments in areas 
relating to behavior, self-concept, self-responsibility, 
and interpersonal skills; 

2. identifying "indicators of progress" or outcomes for the 
student and comparing them to pre-determined standards by 
using product measures such as checklists, file records, 
teacher ratings during observations, and team consensus; and 
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3. review of student materials and short term process records 
placed in a student file, including point cards, graphs, 
and observational data. 

Using these approaches documents child functioning systematically 

at both ends of the program through pre/post testing and product or 

outcome measures. Since many of these measures could be used with all 

the students in a class, the data gathering process is efficient. 

During the program interim, short term process measures can be used as 

time and need allow on an individual student basis. 

Implementing the Plan Systematically 

Even though the teacher specifies the evaluation methods on the IEP 
forms, he/she may find it helpful to construct a matrix, briefly list- 
ing student objectives and selected documentation methods. The matrix 
can help the teacher think through the timing and location of data 
collection for all the students as a group, and serves as an easy refer- 
ence for follow through. It is not necessary that every conceivable 
documentation procedure be carried out, only that a few best measures 
be gathered. 

When collecting progress data, the teacher can usually use a sampling 
approach. It is not necessary that al_l_ behavior be recorded ajj_ of the 
time to generate accurate data. If time and situations are fairly se- 
lected, the data will generally be representative. Sampling will be 
largely determined by the type of measurement involved. All that is 
really important in sampling is that data collection is fair rather than 
biased. The strategy is to spread out the measurements in a logical, 
random sampling manner. . A sufficient number of measurements will 



IEP Measurement Matrix 



Name: 



Objective Areas: 



1. Self-control during regular 
classes 




2. Views self moLe .apable and 
popular 



3. Develops positive friendships 



pre/post 



pre/post 



pre/post 



3rd gr. 



team 
rating 



3rd gr. 



pre/post 



quarterl; 



pre/post 



4. Responsibility for class materials 



Sept-. 



resource 
room 



daily 



5. Accuracy on assigned tasks 



Sept. 



resource 
room 



daily 



6. Controls anger 



Nov. 



group 
class 



daily 
while 
learninc! 



Fig. 1. IEP Measurement Matrix 



balance out normal fluctuations so trends can clearly be seen. 

The following sections describe pre/post, product and process 
measures and give examples of instruments which can be used to docu- 
ment progress. 

Pre/Post Measures 

Many BD teachers have some experience using standardized tests 
in their programs. Those used most frequently include: self-concept 
tests, locus of control scales, peer ratings, attitudinal checklists 
and teacher ratings of behavior. Such devices are initially used to 
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identify students whose behavior deviates significantly from the 
"normal" range and to clarify more specifically areas of student mal- 
adaption or concern. When these instruments are well constructed, meet- 
ing adequate standards for reliability and validity, they can be very 
useful for assessing student progress over a school year's time. Re- 
peated administration of appropriately selected tests can indicate the 
student's functioning at the beginning and end of the program, and 
thereby be used. for generating and measuring progress on shorter-term 
objectives. 

The use of pre/post instruments must be kept in perspective, however, 
as they are not the panacea that will solve all the teacher's needs to 
document progress in behavioral/affective areas. It is important to 
remember that standardized tests and measurements can only be interpreted 
by comparing the child's score to a norm, e.g. a distribution of scores 
generated by compiling a large array of scores of similar persons. Thus, 
the score for an individual student will have no absolute meaning; it 
will be relative to his/her similarity to the group of students used in 
norming the measurement device. Teachers tend to give more credibility 
to such scores than they deserve; the findings must always be considered 
"as compared to" the normal group and "according to the perception of" 
whoever provided the information. There is also a problem with self- 
report devices, where the youngster answers questions about him/herself, 
because his/her responses are influenced by his/her desire to "put the 
best foot forward" or to present a particular picture of unhappiness or 
bravado and so forth. 



Within these limitations of score interpretation, norm-referenced 
assessments can be used to find strengths and weaknesses on fairly 
long-standing, stable characteristics and to measure change in these 
characteristics over a long period of time. Such devices are more use- 
ful to evaluate pre/post change than to monitor moment-to-moment change. 
The characteristics measured, being fairly stable, are not expected to 
show rapid change. Minor fluctuations in response patterns are seen on 
a short-term basis. Jf teachers were asked, for example, to fill out a 
personality questionnaire on a daily basis, they would likely react too 
specifically to individual questions and lose the "global" picture which 
the instrument purports to measure. Thus, the manuals for standardized 
instruments should be checked to: 1) see that test-retest reliability 
standards of at least r = .7 are met and, 2) to find the recommended 
period of lapse time between administrations to gather data which would 
indicate real change versus normal fluctuation. 

With adequate reliability and lapse time between assessments, the 
teacher still needs to have a standard in mind for determining whether 
the child's score is within the average range or whether it is signif- 
icantly deviant. Most quality instruments address this question in the 
manual; if not, the teacher could look for the reported mean score and 
standard deviation and use these indices for evaluating whether the 
score should be- interpreted as significant or not. The normal distri- 
bution diagram in Figure 2 could be used for making this interpretation. 

+ 

The darkened area between -1 standard deviation is considered an average 
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score range. The slashed areas between "1 to "2 standard deviations 
are considered moderately deviant. The dotted areas between *2 to "3 
standard deviations are considered highly deviant and certainly sig- 
nificant. 




significant deviance 



-2SD -2SD -1SD 



Fig. 2. Normal Distribution of Scores 



Teachers can use this same normal distribution diagram to evaluate 
pre/post change scores. The general rule of thumb is that pre/post 
difference must at least equal one standard deviation to be considered 
significant. Using the example in Figure _3, the pre/post change score 
X would not be onsidered a significant amount of change; the pre/post 
change score Y would be considered a significant amount of change. 




X = nonsignificant change score 
Y = significant change score 



Y 



Fig, 3, 



Interpretation of Change Scores 



The types of standardized pre/post measures used in BD programs 
most frequently include behavior rating scales, self-rating instru- 
ments, and sociometric devices. Each will be briefly discussed in the 
following section. 

1. Behavior Rating Scales . Over two hundred behavior rating 
scales are currently available for teacher use in rating students' 
behavior. Special education agencies may require that teachers use 
certain scales which have met quality standards and/or have been se- 
lected to provide uniform information across classrooms and districts. 
BD teachers should ask the program administrator or consultant about 
recommended behavior rating scales for use in their classrooms. Be.- 
fore selecting a behavior rating scale, the teacher will want to read 
the items included in the scale to determine whether they generally 
"fit" students in the program and whether the statements seem stiff ic- 
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iently clear. It would not be feasible to use a scale with many items 
relating to anxiety over academic work in programs for young* nonverbal 
autistic youngsters, or to assess achievement motivation for children 
working on self-help skills. In this author's view, the most useful 
scales are those which focus on overt classroom behavior. 

It may appear to be an oversimplification to point out the person 
selected to fill out the behavior rating scale should be (a) the one 
who best knows the child in (b) the desired setting to be assessed. 
The general education teacher may be the one selected for evaluating 
behavior in the mainstream, but only if he/she has regular interaction 
with that student. The resource room teacher may not be nearly as adept 
as the lunchroom supervisor or the bus driver in rating social skills 
used in the peer group. It may be helpful to get a variety or view- 
points by having more than one person fill out a behavior rating scale. 
When doing this, do not average all the results together. By keeping 
each rater's results separate, comparisons can be made to show how persons 
in differing situations perceive the student's behavior. The rating of 
the person who is close to the content or aim of the IEP objective can 
be used for teacher pre/post, bus driver pre/post, etc. 

Most behavior rating scales offer a number of factor scores on 
dimensions such as classroom disturbance, impatience, and teacher rapport, 
which can be interpreted by comparison to a normative spread of scores 
or to a particular "cut-off score" deemed significant by the test con- 
structors. Where a number of dimensions are combined within a behavior 



rating scale, a method to graph the results is often useful in visually 
reviewing the findings, as illustrated in Example 1. Individual items 
on a behavior rating scale can be used to pinpoint behavior change tar- 
gets, but they are not validly used to document pre/post change, be- 
cause rating scale instruments and factor scores must be used and inter 
preted as they have been standardized. Findings from the behavior 
rating scale can be further validated, or cross-checked, by gathering 
or reviewing behavior observation data, anecdotal records, or other 
process measures. 

Some examples of behavior rating scales are the Devereux Element- 
ary School Behavior Rating Scale and the Behavior Rating. Profile, 

Example 1. Devereux Elementary School Behavior Rating Scale 

Description : Teachers rate 47 classroom behavior items on their 
relative frequency of occurrence. Items are grouped into 11 factor 
scores: classroom disturbance, impatience, disrespect-defiance, exter- 
nal blame, achievement anxiety^ external reliance, comprehension, 
inattentive-withdrawn, irrelevant-responsiveness, creative initiative, 
and need closeness to teacher. The scores are marked graphically on a 
profile sheet. The scale is appropriate for grades K-6. 

Score interpretations : Norms have been established and are dis- 
played on the profile sheet. The average score range is shaded and 
the mean and. standard deviation score ranges are indicated. Both pre/ 
post behavior graphs can be drawn on one profile sheet. This provides 
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DEVEREUX ELEMENTARY SCHOOL 
BEHAVIOR RATING SCALE * 

George Spivack, Ph.D. and Marshall Swift, Ph.D. 
Devereux Foundation Institute for Research and Training 



DESB PROFILE 



Student's Name . 



Larry 



Teacher's Name Ms t Sharp Ears 



Student's Sex 



Age 



Academic Subject 



Heading 



Grade 3 School Anywhere Elanentary Date o£ Rating Pre 9/4/80 

Post 5/20/81 



Pre/ Factor Item 
Behavior Factor Post Raw Scores 



Raw Score in Standard Score Units 
-ISD 0 +ISD +2SD 



1. Classroom 
Disturbance 



#5 3/* 

•tfi CMirral 11 13 ZjSLinltUt 

•••• iranSO^ZS^riwn t 



2. Impatience 



3. Disrespect- 
Defiance 



rf.fy I'ch'r. 



4. Externa] t'esv.h.i, 2 j^34^^bi»«.. 

Blame j jjidji^itt ^ 



5. Achievement 
Anxiety 



External 
Reliance 



• •• alhan 

tm\y I'cU't 



Comprehension 



8, Inattentive - 
Withdrawn 



9. Irrelevant - 
Responsiveness 



2 rvttfM 



1 •bhxMi. 



4 itj. 17^!^fci«fr«»i 

5 44 



Creative 
Initiative 



br,n f . ,n 

•CI. imtf . 



21 j£2t«U HHf. 



(n) Need 



Closeness 1 



■••hi »'ch*». I (3. 31/3 Utmn4\f £\ 



to Teacher 



27 U««H« chanf • 



Additional Items *o q«.m 



41 Sl«- ««rk 




Fig. 4. Devereux Elementary School Behavior Rating Scale 



Copyright 1967, the Devereux Foundation, Devon, PA- Reprinted w 
permission . 



a clear and concise picture of behavior change for easy interpretation* 
Individual item scores can likewise be compiled on one sheet, for easy 
identification of items showing dramatic change. To be considered a 
meaningful change, the post-factor score should move in the desired 
direction at least the distance of 1 standard deviation. Desired di- 
rection for all factors except 7, 10, and 11, is toward the -1 SD end 
of the scale. Factors 7, 10, and 11 are reversed, e,g, 5 the desired 
direction is toward the +2 SD end of the scale. 

Comments : 

1. The same teacher should rate the student's behavior pre/post 
to reduce differences in perceptions and to use the same class 
as the standard of comparison. 

2, Low factor scores on the pre- test may be useful for identify- 
ing goal areas on the IEP. Individual test items could be 
pinpointed as specific IEP objectives. Process measures might 
.be gathered on a short term or sampling basis to provide a prog- 
ress measure and to help validate the post-test factor score. 

Authors : George Spivack and Marshall Swift 

Source : The Devereux Foundation 
19 South Waterloo Road 
•Devon, Pennsylvania 19333 

Date : 1967, 

Example 2. Behavior Rating Profile 

Description : The BRP is a standardized battery of six independently 
normed measures included teacher and parent rating scales, child self- 
ratings, in respect to home, school, and peers, and a class sociogram in- 
strument. Each component yields a total score which has been found' to 
discriminate among groups of emotionally disturbed, learning disabled, 



B R P 



Name . 



Amanda 



BEHAVIOR RATING PROFILE SHEET 



LINDA L BROWN & DONALD D. HAMMILL 



Parent's Name , 

Address 

School Anywhere, USA 



Teacher (Grade) Mrs. Attention 
Examiner . 



Referred by . 



STUDENT itACHER PARENT 
RATING RATING RATING 
SCALES SCALE SCALE 



SONOGRAM 



(Scaled Scores. Wean - 10, Standard deviation - 3) 
COMMENTS: 



Pre 
Post 



Pre/Post 
Date Tested _ 



Ml 

YE 




Date of Birth . 



EM 



At.. 



Pre 



Soka 



Raw 

Scam 



Stutat RatiRf Scales 
Koma Scale 

School Scala 

Nar Salt 

Taaehef Ratine Scala 
Ttachtr £ 1 

Ttachar # 2 

Tuchtr # 3 

Parant Ratine Scala 

Mothar 

Fathtr 

Dthtr 



JtllkP 

7 9/9 4* 



Post 



SaM 
Scuts 



5 ho 

Mi 
////& . 



Sacttfraaa 



Quasi ion # 1 
Quaatkm # 2 
Qutjtion # 3 



Fig. 5. Behavior Rating Profile Sheet 



^Copyright 1978 by Linda L. Brown and Donald D. Hammill. Reprinted 
by permission of the publisher, PRO-ED, 5341 Industrial Oaks Blvd., 
Austin, TX 78735. 
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and normal children. The scores can be used to document the degree 
of perceived deviance and to locate the settings in which the student 
is viewed as deviant. These scores can be graphed on the profile 
sheet for comparison of the scores—each one to the other. These in- 
struments are appropriate for grades 1-12. 

Score interpretation : Each measure has been normed to a mean = 
10 and a standard deviation = 3. The profile sheet uses a dashed line 
to indicate the mean. Both pre/post scores for the child can be drawn 
on one profile sheet, standard deviation ranges can be marked by the 
teacher, and comparisons of change easily made. It is desired that 
each score move in a positive direction toward or above the mean line. 
An extremely high score needs to be confirmed in other ways by the 
teacher, as a high score may be true or it may be falsified. A change 
score should move at least 1 SD, or 3 scale score points, to be con- 
sidered significant. 

Comments : 

1. The same teacher should rate the child's behavior on a pre/ 
post basis in comparison to the same class of children. 

2. These rating scales do not provide factor scores. Individual 
items might be useful for consideration as IEP objectives. 
Comparable items often appear on all three forms—teacher , 
parent and student-.-and thereby are useful for checking sim- 
ilarity of problems across home and school settings, and as 
perceived by the child. 

3. Teachers using the student rating scales, and the sociogram 
questions, should check the following two sections for suggest- 
ions in use and interpretation. 

Authors : Linda Brown and Donald Hammill. 

Source : PRO-ED 

5341 Industrial Oaks Blvd. 
Austin, Texas 78735 

Date: 1978. ? ki 
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2, Self-Rating Instruments . A number of questionnaires and rat- 
ing scales are of interest to the BD teacher because such instruments 
ask the student how he/she feels about him/herself. These have a 
series of statements to which the child responds "like me" or "not like 
me", "true" or "false 11 , or rates of similarity on a scale of 1-5, Those 
most frequently used in school settings deal with self-concept, percep- 
tions of behavior and acceptance by peers and locus of control. Students 1 
responses on these questionnaires are useful in augmenting the teacher's 
view of such concerns. Although there are no direct measures of self- 
concept, the teacher can compare what the student says about him/herself 
to the teachers own observations. 

There is a problem, however, in the credibility of self-report 
devices. They are easily "faked" by the child who wants to "put the 
best loot forward" by giving the response known to be the socially 
acceptable answer. Some students may not clearly know how they feel 
about an item, but respond as others have suggested they should feel. 
Therefore, in interpreting scores from self-report questionnaires, al]__— 
low (negative) scores are generally considered seriously, winTlT^Tgh 
(positive) scores are considered to be questionable^^In either case, 
the teacher needs to look for conf i rmation of the findings of the 
child's actions and unsolicited self-statements. When presenting the 
questionnaire to students, the teacher should enlist honest responding 
by explaining that the questions can help him/her sort out how he/she 
feels about what's going on in his/her life and that there are no 
"correct" answers. 



Self-rating instruments which are well documented provide informa- 
tion in the manual on norms, means, and standard deviations for compar- 
able populations of children. The teacher needs these data to be able 
to interpret the significance of the child's score as well as the change 
score over a pre/post basis. With these cautions in mind, the BD 
teacher will most likely find a comparison of the child's own percep- 
tions on a pre/post basis very useful in yielding insight into the 
child's feelings as well as providing a standardized indicator of change- 
hopefully progress—made on specific objectives in the affective area. 

Example 1, Piers-Harris Children's Self-Concept Scale 

Description : Children respond "yes" or "no" to 80 statements re- 
lating to "the way I feel about myself", including items such as "I am 
a happy person" and "I give up easily". This instrument has been widely 
used and normed for grades 4 through 12, In addition to the total self- 
concept score, factor scores can be derived in the following areas: be- 
havior, intellectual and school status, physical appearance and attrib- 
utes, anxiety, popularity, and happiness and satisfaction. 

Score interpretation : The global score is described as the most 
valid and reliable. The raw score is converted to a percentile score 
for interpretation. The range of scores 31% to 70% are considered to 
be average scores. By applying the percentages occurring in a normal 
distribution, the following diagram can be used, both to establish the 
significance of the deviation of the score, and the significance of. 
scores found on a pre/post basis. Test authors state /that a score 



must change by at least 10 points to be considered statistically sig- 
nificant. 




Piers-Karris Children's Self Concept Scale 



No guidelines are provide v in analyzing the individual factor 
scores. They appear to be primarily useful for exploring the relative 
contributions of each area to the overall global score. The teacher 
can easily determine the percent of items answered in a positive way 
by the following formula for each factor: 

# of items answered in positive direction 
total # of items loading into the factor 

, Comments : No procedure is provided to graph these scores. The 
teacher may find a simple table to be the most efficient way to report 
scores on this test, such as the following: 



Piers-Harris Children's Self-Concept Scale 

(Percentile rating indicating how student feels about himself.) 

(Percent of positive responses (Average score range is 30%-70%) 

on factors within the test: . 

these give a rough profile of ^ — Post 

relative strengths or weaknesses 0/ 0/ . 

and are not weighted scores.) 7o /o 

Comment on Significance of Change: 



Factors - Percent of positive 
responses 



Behavior % % 

Intellectual & school status % , % 

Physical appearance & attributes % % 

Low anxiety % % 

Popularity % % 

Happiness & satisfaction % % 



Authors : Ellen Piers and Dale Harris. 

Source : Counselor Recordings and Tests 
Box 6184 Acklen Station 
Nashville, Tennessee 37212 

Date : 1969. 

Example 2. Nowicki-Strickland Locus of Control 
Scale for Chi ldren 

Description : Students answer M y£s H or "no" to 40 items, indicat- 
ing how externally controlled by fate, luck, or powerful others they 
perceive themselves to be. The total score has been found to measure 
a general tendency for the child to feel he/she can make personal 
choices of action and effect outcomes for him/herself. Examples are: 
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"Do you believe wishing can make good things happen?" and "Most of the 
time do you find it useless to try to get your own way at home?" The 
perception of locus of control has been found to have a significant 
relationship to a child's striving for achievement and self-control. 
Although there are versions for younger children available, this instru- 
ment is normed for grades 3 through 12. 

Scor2 interpretation : A total score is derived and interpreted by 
comparing it to a table of means and standard deviations. The higher 
the score, the greater the student's perception that his/her life is 
controlled by external forces. The teacher will find that drawing a 
normal curve, marking off mean and standard deviation units, and then 
locating the child's score placement will provide the clearest interp- 
retation of significance of the score as well as degree of change on a 
pre/post basis. The general rule of movement of at least one standard 
deviation can be used in interpreting a change score. An example follows 
in Figure 7* 




Grade 7 Males 



mean = 13.15 
S.D. = 4.87 



Norms 




change score X = 4.0 
not significant 



change score Y = 6.0 



X = 4 



k — 

Y - 6 



Fig. 7. 



Use of Normal Distribution Diagram to Interpret 
Scores with Separate Grade/Sex Norms - Nowicki- 
Strickland Locus of Control Scale for Children 
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Comments : No procedure is provided to graph these scores. The 
teacher might find a table useful which provides places to write in 
the normed mean and standard deviation, as well as the child's pre/ 
post scores, as follows: 



Locus of Control - Externality Score 



Quantifies how externally con- 
trolled by luck, fate, or pow- 
erful others student perceives 
his behavior to be, as opposed 
to being internally or self- 
controlled. 



NORMS 

Grade Mean SD 

Pre Si g . Post Si g . 



Comment on Significance on Change: 



Authors : Stephen Nov;icki and Bonnie Strickland. 

Source : Journal of Consulting and Clinical Psychologist 
Vol. 40, No. 1, 148-154 

Date: 1973. 



3. Sociometric Instruments . With the increased emphasis on system- 
atic observation and ratings of overt behavior in the BD field, the gather- 
ing of sociometric data has perhaps been underused the last decade. Socio- 
metric techniques involve having peer members of a class record their 
interpersonal attractions among members of their group. Sociometric rat- 
ings have been found to be one of the most dependable and predictive 
measures of interpersonal traits, and are highly responsive to behavioral 
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change in individuals. Peers may be better judges of interpersonal 
skills than teachers and parents, as the attraction and rejection of 
peers so directly determines the nature of an individuals social 
interactions in a group. 

General education teachers often use their own simple socio- 
metric questions and analyze student responses by drawing sociograms. 
For use in measuring pre/post change of BD children, however, the 
sociometric device needs to be a standardized instrument with ad- 
equate normative data to be able to interpret the findings. Socio- 
metric data most frequently used include the number of "Dsitive 
choices, the number of negative rejections, and a ratio of one score 
to the other. 

A limitation in gathering sociometric data is the requirement 
that class groups with at least 20 members be used. Therefore, most 
special education classes could not be used with these devices. How- 
ever, the more valid determination of a child's social functioning 
would likely be in the regular, mainstream class and it may be more 
appropriate anyway. Also, members of the group need to have been to- 
gether long enough to know each other quite well. If sociometric 
data is being gathered for providing a pre-measure, several weeks of 
a school year need to have gone by to allow group relationships time 
to settle. 

Ex ample 1. Behavior Rating Profile Sociogram 
Description : This instrument was described previously (rating 
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scales - Example 2). The sociometric part of this battery is a peer 
nominating technique in which the teacher selects three pairs of socio- 
metric questions which represent different aspects of the student's 
interpersonal functioning. Seven pairs of questions are available for 
use, representing the areas of friendship, relationships based on 
academic ability, and relationships based on leadership skills. An 
example of a pair is: 1) "Which of the girls and boys in your class 
would you most like to invite to your home after school?" (name 
three) and 2) "Which of the girls and boys in your class would you 
least like to invite to your home after school?" (name three). 

Score interpretation : Difference scores (# of acceptance— # of 
rejections) are used to determine a ranking score for the child within 
the class. This ranking score is converted to a scale score and the 
scale score is entered on. the profile sheet (see previous illustration). 
The deviancy of the score from the "normal" range and the significance . 
of any change found on pre/post ratings are interpreted by the mean and 
standard deviation as described. 

Comments : Peer ratings can provide a global yardstick of change 
in a child's acceptance or rejection by others. Being such a global 
score, however, it is not appropriate for measuring change in a broad 
goal area, rather than being specifically focused on individual ob- 
jectives. Further process measures should be used to describe prep- 
ress on related objectives. 
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Authors : Linda Brown and Donald Hammill 

Source : PRO-ED 

5341 Industrial Oaks Blvd. 
Austin, Texas 78735 

Date : 1978. 

Exampl e 2. The Class Pictures (grades K-3) 
A Class Play (grades 3-7 ) 
Student Survey (grades 7-12 ) 

Description : These three instruments are simple peer rating 
devices in which classmates are nominated to fill positive and negative 
roles. In the K-3 version, positive, negative and neutral picture 
cards are shown individually to children and each child is asked to 
name classmates most like and unlike the picture model.- In the 3-7 
version, the children are asked to nominate classmates for twenty 
hypothetical roles in a class play, including such roles as M a true 
friend 11 and M the part of a bully who picks on children". In the 7-12 
version, students are asked to write the names of classmates who best 
exhibit behaviors provided in descriptive statements, such as "One 
who gets upset when faced with a difficult school problem". 

Score interpretation : Scoring involves computing the percentage 
of negative selections for each child out of his/her total nominations. 
This negative index score has been found to be one of the best pre- 
dictors of mental health adjustment for children when followed up as 
adults, (Routh & Hennings, 1981) Early edition of these instruments 
provided normative data of means and standard deviations. Scores can 
be interpreted similarly to all other measures discussed in this 
section, 
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Comments : No graph format is available for display of scores; a 
simple table could be made for entering pre/post scores as illustrated 
in the Piers-Harris and Locus of Control Scale examples. 

Authors : Eli Bower and Nadine Lambert 

Source : California Test Bureau/McGraw Hill 
Del Monte Research Park 
Monterey, California 93940 

Date : 1961, 

Product Measures 

Throughout the course of a program, certain products will develop 
which can be used for documenting progress. The product may be con- 
crete, such as a record or file of materials, or an outcome behavior--a 
new state of being or behaving--which can be judged or measured. 
Teachers often overlook existing records, believing they must set up a 
new, on-going behavior tracking system to precisely document IEP ob- 
jectives. It is often more efficient to search existing records and 
to use them as "indicators of progress". 

The difficulty for teachers in measuring changes in behavior or 
emotional states at later points in time is that they don't have the 
resources to implement such systems as the "experts" have taught them. 
It is not always possible to think of measurable behaviors which 
really represent the desired student change or easy to specify a cri- 
terion of change. 

What needs to happen is for all to take a more reasonable approach 
to these evaluation concerns and strivr to look for "indicators of 
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change", to accept "consensus" among those directly observing the 
child, and to use professional judgment in establishing criteria for 
change. If teachers can establish some major benchmarks of progress 
which Team members agree have/have not been reached, then new levels 
of behaving or being can be compared to these benchmarks. 

The types of product measurement procedures briefly described 
in this section include criterion-referenced procedures, analogue 
(simulation) observations, and use of archival records. 

!• Cri teri on-Referenced Procedures . Criterion-referenced pro- 
cedures can be used as a form of pre/post measurement. To do so, 
specific criteria for learning or change must be established prior to 
intervention; subsequent progress is then measured against these cri- 
teria. Much more flexibility is available when using criterion- 
referenced measures than when using standardized tests; the teacher 
selects the areas and standards of measurement, the time frame, and 
the specific method of documentation. This approach is, of course, 
the model upon which the IEP requirements are based; during the ear- 
liest stages of a child's program, goals and behavioral objectives 
are to be written with accompanying procedures for measuring progress. 

Criterion measures are similar to end-of-year skill checklists 
used by many teachers. General education curriculae are typically 
laid out in a scope-and-sequence organization and then leveled, so 
that expectations for mastery are clear for each grade level. In mea- 
suring each child's progress in such a curriculum, important questions 



are, M How much has the child gained?" and n What skills has he/she mas- 
tered?" It is of secondary importance (due to the need for grouping) 
to ask, "How does this child deviate from classmates?" and "Is the 
amount he/she has learned adequate?" 

In spite of the popularity of the criterion-referenced approach, 
little practical assistance has been offered educators in using these 
procedures in areas other than learning skills and academics. There 
are few published curriculae to guide the development of behavior, 
maturity, social skills, emotional stability, or self-concept. To 
the degree that BD teachers, together with general educators, can log- 
ically lay out these behavioral ladders of development, criterion- 
referenced procedures will provide a means of measuring precisely what 
changes are occurring. To some extent, it is easy as saying, "Tell me 
what it is you want to teach and then you can make your own rules for 
judging when it's taught." The following two examples provide reason- 
able solutions to the problems of sequencing, providing standards, and 
documenting change without requiring excessive teacher time. 

Example 1. VORT Behavioral Characteristics Progression 

Description : This instrument is a series of behavior progressions 
which has been developed to help teachers assess entry levels for a 
child, guide instruction, and display progress. The individual be- 
havior characteristics are organized into categories and sequenced from 

i 

simple to complex in fifty-nine strands. Although this is a nonstand- 

v 

/ 

ardized instrument, each strand is made up of thirty to fifty charac- 
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teristics which are ordered as similarly to normal skill development 
patterns as is known. Each step in the strand--a behavior character- 
istic—could be used as an objective within the broad goal area rep- 
resented in the strand. The strands focus primarily on adaptive be- 
haviors, self-help skills, developmental skills, and social behavior. 
The BD teacher might find the following strands most useful: attend- 
ance/promptness, listening, adaptive behaviors, impulse control, inter 
personal relations, responsible behaviors, personal welfare, self- 
confidence, honesty, social speech, attention span, task completion, 
reasoning, pre-vocational skills, and health. Two examples are in- 
cluded: #24. Impulse Control and #25 Inter-personal Relations. 

Procedure : a) The teacher determines what the major problems of the 
student are as represented in the Behavioral Charac- 
teristics Progression (BCP) charts. The teacher re- 
views the identifying behaviors section of each strand 
and highlights circles preceding each behavior des- 
criptive of the child. 

b) Systematic assessment is carried out in the behavior 
strand areas deemed most important. Test information, 
teacher-reports, self-reports, and observation data 
can be matched to these strands to verify and place 
the child into the progressive strand. 

c) The teacher and appropriate team members develop an 
IEP by identifying desired steps in each strand within 
the program. These steps provide the objective for 
which intervention plans and evaluation methods can 

be generated. The team needs to decide how they will 
know when each step is accomplished and enter agreed 
upon criteria on the IEP or on an objectives work- 
sheet modeled after the example in Figure 10. 
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Behavioral Characteristics Progression (BCP) 



KAWc 



TEACHER 
SCHOOL 



24 



IMPULSE 
CONTROL 



1.0 


2.0 


3.0 


4.0 


5.0 


6.0 


7.0 


8.0 


Sits cu'etiy 


Sits quietly 


Taxes turns in 


Sits in seat, 


Sits quietly for 


Displays self- 


Changes acti- 




for 30 sec- 


for one minute 


game activity 


stands in lint, 


more than 1 


destructive be- 


vity without 


tine without 


onds when 


when group is 


25% of time 


eta, without 


minute when 


haviors 75 to 


emotional out- 


emotional out- 


croup is 


listening to 


or less. 


fidgeting, mov- 


group is listen- 


700% of base- 


burst when 


bursts when 


listening to 


stories, music. 




ing for 25% or 


ing to stories, 


line. 


change cue is 


alternatives are 


stories, music. 






less of activity. 


music. 




well-defined. 


presented. 


9.0 


10.0 


11.0 


12.0 


13.0 


14.0 


* 15.0 


16.0 


Sits quietly 


Quiets down 


Takes turns 


Sits in seat, 


Wthdraws or be- 


Displays self- 


Calls nr actt 




for more than 


after active 


in game 


etc., without 


comes verbally 


destructive be- 


out while 


in routine with- 


5 minutes 


period (e.g., 


activity 


fidgeting, 


aggressive for 


haviors 50- 


raising hand 


out emotional 


when group is 


recess) if re- 


25-50?i of 


moving for 25- 


short periods 


75% of base- 


for attention. 


outbursts when 


listening to 


minded 


time. 


50% of the 


when tool bed, 


line. 




reasons are 


stories, music. 


freauently. 




activity. 


criticized, etc 






explained. 


17.0 


18.0 


19.0 


20.0 


21.0 


22.0 


23.0 


24.0 


Raises hand 


Sits quietly for 


Takes turns in 


Sits in seat, 


Sits quietly 


Takes turns in 


Sits in seat, 


Displays self- 


for attention. 


more than ten 


game activity 


stands in line, 


for a full 


game activity 


stands in line, 


destructive be- 




minutes when 


50-75% of the 


etc,w/ogt fid- 


period when 


75% or more 


etc.,w/out fid- 


haviors 25- 




group is listen- 


time. 


geting, moving 


group is lis- 


of the time. 


geting, moving 


50% of base- 




ing to stories, 




for 50-75% of 


tening to 




75% or more 


line. 




music. 




the activity. 


stories, music. 




of the activity. 




25.0 


26.0 


27.0 


28.0 


29.0 


30.0 


31.0 


32.0 


v- v!ccs down 


Leaves 


Controls 


Accepts most 


Changes activi- 


Displays self- 


Displays effec- 


Acts according 


immediately 


provoking 


physical 


criticism 


ty without 


destructive be- 


tive behavior 


to social rules 


after active 


situation. 


responses 


with no 


emotional out- 


haviors 0-25% 


appropriate 


in work & play 


period and 




when 


emotional 


burst when 


of baseline. 


for the situa- 


situations. Does 


awaits instruc- 




angered. 


outbursts. 


change is an- 




tion/piace. 


not cry when 


tions. 








nounced. 






loses game. 


23.0 


34.0 


35.0 


36.0 


37.0 


38.0 


39.0 


40.0 


Avoics disrup- 


Controls tem- 


Accepts 


Plays and 


Recognizes 


Plans/ 


Touches others 


Maintains 


tive actions 


per well: verbal* 


friendly teas- 


works without 


own lack of 


considers 


in a manner 


self-control 


in pubhc 


izes feelings in a 


ing—smiles or 


interfering with 


self-control 


action be- 


suitable for 


when faced . 


places. 


manner accept- 


laughs. 


or disrupting 


and works 


fore carry- 


the home, 


with failure, 




able to home, 




work of 


with other to 


ing it out. 


school, neigh- 


problems, dis- 




school, etc. 




others. 


improve self. 




borhood, etc. 


appointments. 




Identifying Behaviors 



O Displays self-stimulating behaviors ODisplays self-destructive behaviors 
OBIows up, becomes excited, loses self-control when he cannot do or get 
what he desires, encounters problems, etc.OWithdraws or becomes aggressive 
for long periods when scolded, criticized, teasedOOverreacts to the slightest 
provocationOBlows up, gets excited, etc., when offered constructive, helpful 
criticismODisplays inappropriate affectODisplays inappropriate facial ex- 
pressions 



Fig. 8. Behavioral Characteristics Progression (BCP) 
Impulse Control 



Copyright 1973. Santa Cruz County Office of Education. Published by 
V0RT Corporation, P.O. Box 1132, Palo Alto, CA 94306. No part of the 
document may be reproduced in any form by photostat, microfilm, retrieval 
system, or any other means without prior written permission of V0RT 
Corporation. 
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Behavioral Characteristics Progression (BCP) 



SCHOOL 



25 



INTER-PERSONAL 
RELATIONS 



1.0 2.0 3.0 4.0 5.0 


6.0 


7.0 8.0 


Srves. oc*s = .eac~e s for 
-c \* ^ ? - 'ami liar 
a^c:~*' pvson people, 
enters ;n« 
room. 


Becomes auiet 
jwnen caressed. 

i 


( Hoios head up 
in group acti- 
vities such as 
eating, games, 
etc. 


Returns smile 
when smiled 
at. 


•Watcnes the 
movements of 
others— shows 
interest. 


Demanas per- 
sonal atten- 
tion by mak- 
ing noises. 


Seeks atten- 
tion of others 
(e.g., repeats 
performances 
that are 
laughed at). 


°° 10.0 11.0 12.0 13.0 14.0 15.0 1fi n 


■Vioves near [Accepts help 
otnersaunrg ;from others 
free play. ! (e.g., wnen 

iworking on 

'task). 


Plays alone in 
presence of 
others. 


Shares when 
told to do so 
butcomplains. 


Hits another, 
making ex- 
cuses to tea- 
cher when 
confronted 
with deed. 


Exchanges 
items for play. 


Watches 
others play 
and may 
Join in for a 
few minutes. 


Plays 

individually 
with adult. 


17 -° 18.0 19.0 20.0 21.0 22.0 23.0 ?4 n 


n:;s a^ct^e*. ♦ Plavs witn 

ma K.n5 excuses »otners. 
lo thirc party 1 
(e.g.. goes „ 
to :escne r *. ! 


Responds to 
and makes 
verbal greet* 

ings. 


Plays coopera- 
tively with 
another child. 


Shows affec- 
tion for famil- 
iar person 
(e.g., hugs, 
pats, kisses, 
etc.}. 


Accepts and 
shows affec- 
tion appro- 
priate to 
home, 

school, street. 


H its another, 
afterwards 
verbalizing 
reasons to 
the one hit. 


Hits another 
and verbalizes 
while hitting. 


25.0 26.0 27.0 28.0 29.0 


30.0 31.0 32.0 


Verbalizes [Takes turns, 
feelings to ! 
anotner, tier; . 
mts nim. ( 

i 


Plays with 
group of 
three or more. 


Plays coopera- 
tively in group 
activity. 


Bargains with 
other children, 


Verbalizes 
feelings to 
another with- 
out hitting. 


Plays group 
cooperative 
games with 
loose rules. 


Interacts with 
others, keep- 
ing fighting or 
quarreling to 
minimum. 


— 3^.0 35,0 36.0 37.0 38.0 39 0 40 0 


P avs cc^oet- . Aooloci:es i Plays simple 
tive active I without being 1 competitive 
ca^es s-c"* as reminded. Itaole games 
K 23 sees. 'such as "fish," 
"old maid," 
(dominoes. 


Offers help to 
others volun- 
tarily. 


Protects other 
children and 
animals. 


Shares toys IComforts play* 
with other mates in 
children. [Distress. 

i 


Plays difficult 
games re- 
quiring skills, 
scoring and 
knowledge of 
rules. 


41.0 42.0 43.0 44.0 45.0 46.0 47.0 48.0 


3enaves in a JContributes to 
courteous maniclass discus* 
ner to oeers jsions and acti- 
ana ste". jVities. 


Participates in 
peer-group 
activities when 
not asked. 


Disapproves of 
offensive peer 
behavior by ig- 
noring or 
actively dis- 
couraging it. 


Verbalizes 
feelings of 
anger with 
other stu- 
dents/teacher. 


Initiates a 
compromise to 
resolve con- 
flict with 
peer. j 


Uses actions 
of others as 
social cues 
(e.g., stands, 
kneels, whis- 
pers, shouts), i 


Takes part in 
peer group 
activities such 
as clubs, 
teams, dances, 
parties. 



49.0 



50.0 



p artic Pates m : Leaas peer 
P9* r -c r ouo Jcrouo in 
activates warious play 
.vpet a s • 5 c •.••c r k 



Identifying Behaviors 



ORarely plays with other chi!drenO"Negative" contributions to class dis- 
cussions & activitiesORarely sPeaks, leads activities or volunteersOPlays 
w/objects rather than peopleOUses others to gain own ends, reward while 
depriving them of same chanceQAIienates peers by teasing, arguing or being 
cruel O^arely shares w. ; othersO^arely participates in group activitiesOPlav; 
\%.th younger chiloren instead of peersO pi 9 n ts. hits, bullies, bosses peers 
O Considered weird bv oee r s 



Fig, 9. Behavioral Characteristics Progression (BCP) 
Inter-Personal Relations 



Copyright 1973. Santa Cruz County Office of Education- Published 
by V0RT Corporation, P.O. .Box 1132, Palo Alto, CA 94306. No part of 
the document may be reproduced in any form by photostat, microfilm, 
retrieval system, or any other means without prior written permission 
of V0RT Corporation. 
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BCP LEARNER OBJECTIVES WDRKSHEET 



Office of Education 
School System 

PUPIL ADDRESS BIRIHDATE 
.TEACHER SCHOOL . DATE 
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r AT- 
TAIN- 
MENT 
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METHODS, MATERIALS, 
COMMENTS, ETC. 
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Fig. 10. Chart for Recording IEP Objectives 



d) The VORT booklet offers an observation format for 
ongoing data recording relating to accomplishment 
£>n the objectives for a class of students. The 
example in Figure 1_1 illustrates how this could be 
adapted to serve as daily check-charting for a group 
of students, each working on different behaviors, 
for a month's duration. VORT suggests that a code 
(such as the following) be used in check-charting. 



No opportunity offered child to display behavior 



Child does not display behavior when given op- 
portunity. 



36 
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E 



X 



Child displays behavior a portion of time 
(emerging) but less than criterion set. 

Child displays behavior at criterion level 



Behavior has met criterion established for 
objective and is no longer being tracked. 



e) On a monthly basis, the teacher updates the behav- 
ioral strands chart by marking off all objectives 
according to the established criteria, by 1) col- 
oring in the entire step box in yellow highlighter, 
2) writing in the date of accomplishment, and 3) 
x'ing out any .identifying behaviors which no longer 
apply. 



Comments : 

1. This instrument provides an excellent illustration of how a 
series of objet/;ives can be sequenced and the format used to 
display progre s. The structure is straightforward, the in- 
strument provides sequenced interim objectives, and uses 
process measures to the extent possible to document comple- 
tion of objectives. 

2. The sequence of objectives within each strand may not be 
logical when applied to individual students. Students typ- 
ically show uneven achievement of these behavioral skills. 
No attempt should be made to fit the child's program to the 
strand sequence unless it makes sense for the given child. 
The objectives may simp'y be used as separate progress cri- 
teria without requiring movement through each step of the 
strand. 

3. The check-charting illustration is actually a process measure 
but shows how it can be combined with a criterion referenced 
measure. 

4. With some experience working with the behavior strands of 
this instrument, teachers should be able to develop their 
own behavior progressions by task analyzing desired goals 
for their students. 

Authors : Office of the Santa Cruz County Superintendent 
of Schools 

V 

Source : VORT Corporation 
P.O. Box 11132 

Palo Alto, California 94306 
Date: 1973. 
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Fig. 11. Daily Check-Charting 

9 



Example 2. Goal Attainment Seal ing--Objectj ves Written 
at Each Scale Level . 

Description : Goal attainment scaling is a flexible procedure in 
which a series of objectives are written. These objectives are then 
used as outcome levels at the end of the program for documenting and 
measuring progress. The objectives, written at each scale level 
(most unfavorable, etc, )--al I five levels—are not based on test items 
or strands of behavior characteristics and, thus, require more con- 
ceptual creativity on the teacher 1 s part. The approach may be more 
satisfying, however, as the behavior objectives for the child are truly 
individually determined. Also, the objectives, scaled within each 
goal area, can be written for other program aspects which greatly im- 
pact the child, e.g., greater consistency in home management or use of 
adapted materials by mainstream teachers. 

Learning to write good goal scales comes from experience in Writ- 
ing and using scales. Experience improves ability to write different 
outcome levels in clear behavioral terms, to think in terms of range 
of outcomes, and to make more accurate predictions. Although the pro- 
cedure requires an individual program for each student, there are 
commonalities among student problem areas. After writing a number of 
scales, teachers often find items from previously written scales can 
be re-used and that gradually a bank of scales is accumulated. 

Originally, two basic' elements of the Goal Attainment Scale were 
suggested: 1) the specific goal and objectives, and 2) the five 
levels of the scale, e.g., most favorable, more than expected success, 
etc. 




An example of these elements appears in Figure 12. 



SCALE HEADINGS: 
LEVELS; 


GOAL AREA: 

TASK BEHAVIOR 

{weighty ■ > , 


Most unfavorable 
#utcome thought 
liktly 


Almost no work accomplished 
in spite of continual 
tocher intervention. 


Leu .than 
expected 
success 


Completes h to h of assign- 
ments with continual prod- 
ding and ultimatums. 


£xp#cted level 
Of success 


ujn^icuBs one— iisLLr or ex- 
pected assignments in 
resource room with frequent 
prodding. 


Mori than 
•xpecttd 

success 


Completes most assignments 
with 1 to 2 reminders, 
per assignment. 


Most favorable 
outcome thought 
likely 


Completes most assignments 
with no reminders. 



Fig. 12. Elements of a Goal Scale 
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Three to four priority goal areas should be selected for the 
student. These priorities will not necessarily include all the im- 
portant work to be completed with each child, but should represent 
the major goal areas of the special education program during the 
time period covered by the Goal Attainment Scale. The levels repre- 
sent shorter-term objectives within each goal area. Figure 1_3 provides 
a sample of a complete Goal Scale written for four goal areas: non- 
compliance, tolerating frustration, peer interaction, and homework 
completion. The levels within each goal strand clearly show a logical 
sequence in which completion of an objective at a lower level leads 
directly to the next higher objective. 

Procedure : 

a) At the IEP meeting, priority areas are identified, given a 
descriptive title, and written in the scale heading boxes as goal area 
titles. Team discussion about what the team... 

a) would like to see the student accomplish, and 

b) realistically expects the student to accomplish 

will aid the teacher in later writing an objective for each level. The 
team should determine the time frame for the scales and the starting 
and ending dates. The most common score date is May, at the end of the 
program year. 

b) Generally the teacher wri tes--the-ebje€-t-fves-~er outcome state- 
ments for all levels of the goal scales. The middle box, being the 
"expected" level, should be written first and then at least one level 
on each side of the middle box must be completed. In writing the "ex- 
pected" level, it is important to keep the time span in mind, as 
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Start Oil* 

Mr. Organized 
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GOAL ATTAINMENT SCALE 

Fig. 8 Complete Goal Scale for One Student 
'Entry Ltvel % Exit Level 



Sain Troublesome 


Student Nama 




Upper Elementary 




School 




Anywhere, USA 





Town 



iCALE HEADINGS: 
-EVELS: 


bton-Compliance 
(weight i ■ I 


Tolerating Frustration 
(weight 2 " 1 


Peer Interaction 
in Social Skills Group 

<weight3 - | 


■f 1 

i 

Homework Completion 
for Mainstream Classes 
(rate last quarter ; 
of year) 
(weighty ) 


dost unfavorable 
*jt com a thought 
ikely 

Score — —2 


*Complies with 25-49% of 
directions with constant 
teacher reminders. 


* Reacts to frustration loud- 
ly (crying) and physically 
(pounding desk or ripping 
worksheets) . 


*Turns off peers by bragging 
bossiness, and "tough guy" 
act.' 


, *Completes no assign- 
ments on time. i 

■1 

1 


Lets than 
txpecttd 
luccess 

Score ~ — 1 


Complies with directions 
50-74% of time with the 
use of clear teacher sig- 
nals and token reinforce- 
ment. 


Reacts to frustration by 
refusal (saying "I won't 
do it."). 


(xntinues bragging, bossiness 
and "tough" behavior, but 
responds to adult reminders 
to interact more appropri- 
ately. 


, Completes less than 
*5 of assignments 
on time* 


Expected level 
if success 

Score = 0 


Complies with directions 
75-100% of the time with 
the use of clear teacher 
signals and token rein- 
forcement. 


Reacts to frustration by 
verbalizing difficulty to 
teacher with no loud or 
physical mannerisms. 


Marked reduction in bragy 
ging and "tough" behaviors 
with some cueing from 
adult. 


Completes between* 
to 3/4 of his assign-* 
ments on time. 


Hort than 
xpactad 

uocets 

Score = *-l 


Complies with directions 
75-100% of the time with 
only the use of clear 
teacher signals and 
praise. 


Iteacts to frustration by 
verbalizing problem and 
asking teacher for help. 


Appears to modify own 
"tough" behavior -^catches 
self and changes behavior 
without adult reminders or 
prompting. 


Completes between 
3/4-90% of Ms i 
assignments. 


lost favorable 
utcoma thought 
kely 

Score =» +2 , 


Complies with directions 
90-100% of the time with 
the use of teacher praise. 


Deals with frustration 
independently using self- 
help devices and coping 
skills (e.g. skipping hard 
problems) . 


Interacts positively with 
peers with no display of 
"tough" act. 


Completes all assigrr- 
ments. 



Fig. 13. Complete Goal Scale for One Student 



predictions for a six-week evaluation program will certainly differ from 
those for an entire year. The expected level, stated in the middle box, 
should represent the most realistic prediction of the outcome behavior 
to be attained, not necessarily all that one hopes will be attained. 

The other outcome levels are thought less Ifkely to occur. The 
"more than expected success" and "most favorable outcome thought likely" 
levels are-guides for program planning in the future and for document- 
ing unusually good student progress. Correct use of the Goal Attain- 
ment Scale technique would not find these levels being reached very 
frequently. Similarly, the "less than expected success" and the "most 
unfavorable outcome thought likely" should not occur very frequently. 
These less favorable outcomes balance the picture- of possible outcomes, 
pinpoint children and priority areas needing closer evaluation, and 
help judge when special needs go beyond the program's capacity to 
meet them. 

When a goal scale is written, only one behavior appears in each box. 
Including more than one behavior in a box can cause problems with split 
scoring. It is not necessary that each level be written in a measurable 
manner, but each must be written clearly enough that two or more persons 
can agree that the level of behavior has/has not been met. 

c) If the student's behavior at the time^of contruction of the 
scale is equivalent to any of the five levels, the entry level should be 
indicated by placing an asterisk in the corner of the appropriate box. 
It is not required that the entry level be otherwise documented if the 
team agrees, but it strengthens the scale's validity when it can be 
based on test data, rating scales, anecdotal records or observation data. 
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d) At the indicated score data, two or more persons should confer 
and score the Goal Scale. It is helpful when scale outcomes can be 
supported in various ways with tests, rating scales, or process measures. 
Each scale is marked with an "x" at the appropriate outcome level. The 
marked Goal Scale will then visually show whether or not the "expected" 
levels of outcome are reached and whether or not change occurred. This 
marked Goal Scale form will generally be sufficient for I EP use, as it 
documents the degree of change on the goals relative to the predictions 
of change made by the teacher and planning team. 

Scoring : Goal Scales can be scored numerically as follows: 

-2 = most unfavorable outcome thought likely 

-1 = less than expected success 

0 = expected level of success 

+1 = more than expected, success 

+2 = most favorable outcome thought likely 

A large number of these student scale scores can be used in program 
evaluation or research by graphing their distribution in various cate- 
gories of interest. The teacher's use of the individual scale scores 
would probably only be for record-keeping purposes. 
Comments : 

1. This evaluation approach was developed for use in mental health 
programs where it was recognized that many goals in the affective-emo- 
tional areas may be difficult to measure quantitatively. Although it is 
important that the levels be written in as behavioral a style as possible, 
the beauty of this format is the flexibility offered to establish goals 
and objectives which are describable and ratable , not necessarily 
measurable. 

2. ' Several team members can contribute individual scales to one 
overall Goal Scale for a child, thereby increasing agreement on goals 
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and expectations across the team. For example, an O.T. may develop 
scale(s) in self-help skills, the language clinician in communication, 
the social worker for a home toilet training program, etc. 

3. It is advisable that more than one person be involved in 
writing and scoring the Goal Scale. Generally, a teacher, program super- 
visor, and parent could share this responsibility and periodically confer 
on progress and program adjustments. Having a team involved in the pro- 
cess provides a check and balance mechanism to avoid setting expected 
level statements unreal istically high or low. 

Original Source : Kiresuk and Sherman (see bibliography) 
For a "Self-Instructional Packet in Learning to Write Goal Attain- 
ment Scales" prepared by Fitzgerald, Fleckenstein & McKinnon, 1978, 
contact: 

Gail Fitzgerald 

Child Psychiatry Service 

The University of Iowa Hospital and Clinics 

500 Newton Road 

Iowa City, Iowa 52242 

2. Analogue Observation . Analogue observation occurs when a 
teacher observes a behavior in a simulated situation, rather than waiting 
for the behavior to occur spontaneously in the natural environment-. TMs 
is a product whereby the new behavior (product) is assessed after-the 
fact, rather than as it is developing. This technique has been parti- 
cularly helpful in assessing students' self-control and social irjo* action 
skills. To carry out this approach, the teacher sets up a - o t e play 
situation, or directly establishes a si. -ition in which the stident has 
the opportunity to display the behavior of interest. A;«r : ^cj obser- 
vations are often more efficient than observation ^% naturally 
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occurring events and provide a more precisely controlled means of 
assessing responses to specific stimulation. It is relatively easy 
for trie BD teacher to develop pairs of similar role play situations, 
or to systematically trigger a classroom situation, or set up a game, 
so that the child's responses can be observed and rated on a pre/post 
basis. 

Analogue observations are based on the assumption that behav- 
ior in a simulated setting is quite similar to that occurring in a 
natural setting. Although most published studies have shown that 
this type .of evaluation is sensitive to the effects of behavioral 
intervention with students, some limitations should be kept in mind. 
There is no guarantee that the behavior observed in analogue will 
generalize to other times and settings. The observed behaviors may 
not be the "real" ones. Some behaviors are easily elicited in con- 
trived situations; others may not easily be triggered in a situation 
which is not natural and is more public. The behavior displayed may 
be reactive, or influenced by the group make-up or by obtrusi veness 
of the observation procedure, e.g. video-taping. Even where pre/post 
differences are documented, the findings can only be interpreted in 
respect to criteria established by the teacher. 

In response to these limitations, teachers can use several 
guidelines to make analogue observations more valid. First, the 
teacher should make the analogue situation as similar to the natural 
environment as possible. Even though simulated, most social inter- 
action situations can be "staged 11 in informal settings such as recess, 



a class party, or the lunchroom. Second, the teacher should try to 
hold as many environmental factors constant as possible by using 
the same members of the peer group, the same game, or the same type 
of emotional content or subject matter in role plays. Third, after 
using analogue observation on a pre/post intervention basis, the 
teacher should carry out comparable checks in other settings and at 
later times, A good rule of thumb would be to do the analogue ob- 
servation pre, post, and in at least one other setting or one follow- 
up time in the same setting/ 

The examples which follow illustrate analogue observations of 
self-control techniques game-playing skills. The rating forms used 
with the observations are simple devices which teachers can easily 
design by "thinking through" a situation. The two examples could be 
carried out as frequently as desired. To use this information to 
document IEP objectives, the teacher could describe progress in a num 
ber of ways: a) pre/post frequency of positive behaviors; b) re- 
sponse to various types or levels of precipitating events; c) level 
of positive behaviors in various settings; or d) maintenance of 
positive behaviors at follow-up checks after direct teaching or rein- 
forcement have ended. 
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Example 1. Self-Control Monitoring 

Much V/ork is done with BD children to get them to practice self- 
control when faced with teasing, fighting, and frustration. The 
Turtle Technique -s a program for teaching children to use self-con- 
trol procedures similar to a turtle who is adept at: a) withdrawing 
into his shell when he feels threatened, b) using muscle relaxation 
to reduce the tendency to strike out, and c) using problem solving 
as an approach to handling the difficult situation. After children 
have learned and practiced the technique on cue from the teacher, gen- 
eralization training is provided by having the teacher and "confed- 
erate" peer attempt to provoke others as a way to get them to use 
turtle responses. There are several stages at which analogue record- 
ing is desirable: initial learning, end-of-practice phase, general- 
ization training, and follow-up. The teacher could monitor a chi 1 d 1 s 
use of the technique in simulated as well as in natural situations by 
filling out a 3 x 5 note card report as seen in Figure H. A file of 
these can be kept and used to set up a simulation if needed, in addi- 
tion to monitoring natural occurrences.* 



Schneider, M. , and Robin, A. Turtle Manual. Stony Brook: Psycholoqy 
Department, 1974. : 
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Self-Control Monitoring 

Name : ; Date : 

Place : Hue : 

Precipitating Event: 

Response : 



Outcome: 



Fig. 14. Teacher Monitoring of Self-Control Procedures 

Example 2. Observation Questionnaire 

Checklists and questionnaires are easy to devise and use in 
analogue observations. Teachers can write their own items or use 
items from prepared program checklists. Whatever the item source, 
wording should be checked to make sure observable terms are used; 
concrete behaviors can be more reliably rated. An observation 
questionnaire can be completed while the activity is in process if 
an outside^ rater , such as the teacher aide, is present to do so. 
Generally a delayed report can be reliably filled out immediately 
following the activity, if the observation period is kept relatively 
short, perhaps ten to fifteen minutes long. 

Using a short observation period is important in delayed re- 
cording because it reduces memory confusion and subjective inter- 
pretation. It is important that students not realize they are being 
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SOCIAL SKILLS OBSERVATION 



Directions : Fill out this questionnaire after, you have observed 
game playing for 10 minutes. Fill out a different questionnaire 
for every 10 minutes observed. 



Student \ Date 

Game peers 



Game . Class 

Observer ____ Time 



0 = this did not occur during the time of observation 

1 = this happened once 

+ = this happened more than once 
* = this happened consistently 



1. Student takes turns in sequence. 0 1 + 

2. Student handles gams materials properly, 0 1 + 

3. Student explains rule or move to peer, 0 1 + 

4. Student takes suggestion ' from peer, 0 1 + 

5. Student accepts a "ruling" without argument, 0 1 + 

6. Student gives peers encouragement, 0 1+ 

7. Student accepts outcome without bragging 

or complaining, 0 1 + 

8. Student helps pick up game, 0 1+ 
etc. 



Fig. 15. Teacher-Made Analogue Observation 
Ratinq Form 
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rated. While video and audio taping seems to be an appealing idea, 
it is unlikely the student responses will be totally natural if they 
have knowledge of the taping. 

An example of a teacher-made questionnaire is seen in Figure 15 
which could be used in a delayed report of game skills, 
*%♦ 

3, Archival Records , Within the regular school system, data 
is systematically gathered which can be used to measure student prog- 
ress. Most common records include attendance rates, tardiness, class 
cuts, grades, disciplinary action reports, and parent contacts. De- 
pending on the creativity of the teacher, other indices for change 
may be found all around the environment—marks on a desk top, number 
of torn workbook pages, accidents on the playground, teacher com- 
plaints, teacher sign-out sheets for special education materials, 
student library records, physical education skills checklists--just 
waiting to be used to show change in behavioral/affective areas. 

Abstracting information from these records may be time-consuming, 
but they have a great advantage in yielding credible information be- 
cause they provide evidence of events as they occur , rather than 
after-the-fact. The records are products, but they were generated on 
an on-going basis. Data from these type of records usually can be 
graphed on a frequency-across-time format and related back to student 
objectives. 



Example 1. Class Attendance Rates 



School offices generally maintain lists of reported absences 
period-by-period for each day. Compiling and graphing this inform- 
ation daily would likely get monotonous and too detailed to dis- 
play major patterns of change. It would be much more impressive to ■ 
compare such data on a. month-by-month basis as seen in the following 
graph where the levels of change are dramatic. 
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Fig. 16. Graphing of Class Attendance Data 
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Example 2. Behavior Card File 

Sometimes programs can be set up so records are automatically 
built into the program structure. An example is the CARE Program 
in Sioux City, Iowa, first implemented by Delia Sorathia, and later 
revised and described by Lynn Johnson. The program is basically 
a token economy for secondary BD students which teaches students 
responsibility for their own behavior. The record-keeping system 
is totally integrated into the program's operation. 

Whenever a student in CARE displays an unacceptable behavior, 
the student earns a Behavior Card. On this card is written, in a 
positive manner, the behavior that is expected of the student. An 
example is to n walk on the floor" versus "do not walk on the desks". 
The format for the cards is as such: 





BEHAVIOR CARD 


Nane: 




Date Earned: 


Date Conpleted: 


Behavior: 




Trials: 




Date/Initials: 



Fig. 17. Behavior Card 
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Each student 1 s behavior card gees into a file under his/her 
name. When the student arrives at school, he/she chooses his/her 
behavior card to concentrate on for the full day. Most students 
select one or two cards each day. Throughout the day, the student 
is awarded points for accomplishing the stated behavior. If the 
appropriate behavior continues throughout the entire day, the card 
is initialed, dated and additional reinforcement is provided through 
the token system. Each day the student has not been successful is 
noted on the "trials" line. After the card has been initialed three 
times, the teacher removes the card from the student's active file. 
If the behavior ever reccurs, a new card stating the same behavior 
is placed in the student's file. Each day the number of Behavior 
Cards a student has are counted, and that number is plotted on a 
graph. This provides .an ongoing representation of progress for the 
student. Every five days the number of completed cards is recorded 
on a graph as a second progress record. 

Although this system includes other record-keeping components 
in other program areas, the behavior recording system seems strikingly 
easy to implement and maintain over time* At the end of the program's 
duration, the teacher can compile information on number and repeti- 
tions of behavioral difficulties, duration, and time lapse in 
successfully completing the cards. Also important would be any notes 
of documentation- made, on the reverse side, such as mainstream teacher 
comments. The graphs serve as excellent process measures of ongoing 
progress. 



Process Measures 



Process measures are designed to describe the course of change 
and are the measures most frequently thought of in documenting prog- 
ress on IEP objectives. There are many variations of these measures, 
but the major types include: frequency counts, duration recording, 
point system graphs, self-ratings, and systematic observation. Proc- 
ess measures play different roles than pre/post or product measures. 
Because objectives in a program change frequently, process measures 
are used to measure shorter-term progress, to show whether progress 
is directly related to an intervention, and to provide systematic 
feedback to help the teacher make necessary adjustments in interven- 
tion efforts. Process measures nicely complement global pre/post and 
product measurements; they serve to cross check of back-up the data 
and to more sequentially describe the child's progress. 

Process measures are primarily completed on a "document-as-you- 
go" basis, where the problem defines the method used. The teacher 
needs to have a large repertoire of process measurement skills and to 
be adept at integrating them into his/her teaching and management 
structure. A useful analogy would be to compare the gathering of 
process data to that of building a student file in general education 
classes—into that file go examples of student work, teacher comments, 
criterion-test scores, achievement graphs, and notes from parents and 
teachers. Likewise, for the BD student, the teacher needs to build a 
file of evidence of progress over time, but instead of it being a 
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learning file, it needs to be a behavior file. 

Although the analogy makes the task sound simple, it is often dif- 
ficult to accomplish in the behavioral/affective areas. The setting- 
up, recording, and compiling of behavioral data, can be extremely time- 
consuming. " In classrooms where aides, volunteers, older students, or 
the children themselves can assist, the teacher should be able to ar- 
range instruction and people in ways to gather some information some 
of the time. The process measurement procedures selected by the teach- 
er will probably change from month-to-month in response to needs and 
program structure. It should be a creative and flexible process; un- 
less the teacher chooses to use a given method over the entire pro- 
gram's duration, he/she should not feel committed to implementing a 
procedure just to gather data when it no longer is useful programmat- 
ical ly . 

Anecdotal records will not be discussed in this chapter as a 
measurement device. Typically, anecdotal records are very subjective 
and unsystematic. While the teacher may feel it's useful to record im- 
pressions of the student and significant happenings anecdotally, they 
do not substantiate progress in any credible manner. Anecdotal records 
do help keep track of the events of the year and could be used, just as 
the teacher's plan book, to link together the sequence of events, as 

timing of interventions, and the gathering of progress information. 
2 

Haskell reports an alternative method of writing brief behavioral 

Haskell, S. A time-reference Q-sort technique for evaluating behav- 
ioral change. American Journal Orthopsychiatry , 1979, 419 (1), 
109-120. 



descriptions of students periodically instead of anecdotal records. 



These behavior descriptions, written on index cards, are then given to 
a panel of judges to make Q-sort ratings. The ratings generate scores 
which then can be used to measure adjustment in relation to time. 
This approach to using anecdotal records may be promising in the 
future; however, at this point, further practical work is needed with 
the method. 

Most of the examples described in this section can be implemented 
by the sufficiently organized teacher. The teacher should keep the 
following guidelines in mind when designing process measurement proced- 
ures to improve the quality of the yielded information: 

1. Be realistic : ^ Do not try to gather data on all the students 
at the same time. Focus on one or two students during crit- 
ical moments of the day; use a sampling strategy; or use the 
same basic system for several students at a time. Think 
through the day—make sure time or help is available not only 
to gather, but also to compile the information. 

2. Be systematic : After specifying what data to gather, figure 
out a routine for getting it. Information collected haphaz- 
ardly is rarely representative--!' t only reflects the action 
of the day when activities go as planned'. Less data collect- 
ed on a fair, representational schedule will be more accurate 
and useful . 

3. Pre-plan : Keep the long-range plan for each child in mind. 
Determine when and where the big pushes for behavioral/affect- 
ive change will come,. Have the time and the measurement sys- 
tem ready when the student is ready, so the total cycle of 
change can be documented. 

4. Be objective : Focus on overt behavior that is measurable or 
describable. Keep subjective judgments out of the data file, 
or at best, note them on the reverse side of forms where they 
won't cloud an objective review. Follow the plan as estab- 
lished; do not change the rules or the schedule so that the 
"wonderful deed" or "convincing evidence" gets recorded just 
because it caught the rater's attention; if necessary, record 
its happening elsewhere. 
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5. Build the procedure into the lesson plan book : Don't rely 
on memory; when a commitment is made to gather data, write 
it on a file card and clip it into the plan book. Most of 
the work is completed once the procedure and strategy are 
decided— so 'carry it out. Set up a charting system for 
yourself— check it off and give yourself a pat on the back! 
J, Good recording." 

1. Point System Procedures . The accumulation of points for pos- 
itive behavior is likely to be the most frequent type of data currently 
generated in BD programs. Points, are given in many forms — tallies, 
tokens and ratings. They are relatively easy to hand out or record 
while activities are in process. The measurement questions confront- 
ing teachers in running point systems are determining... 

a) the definition of a behavior equivalent to a point, 

b) the most efficient method for dispensing points, 

c) the data recording format, and 

d) a method to compile and interpret the points on a 
unit-of-time basis. 

The teacher can be innovative in specifying the answers* to these ques- 
tions as long as points can be given and recorded reliably, the system 
is convenient, it easily displays progress in an understandable way, 
and the results can be related back to questions about behavioral/ 
affective improvement. The following examples illustrate a variety of 
process measurements based on point systems. 

Example 1. Frequency Counts 

To use this method, the teacher counts the number of times the 
behavior, as it has been defined, occurs in a block of time. The 
frequency method should be used when the behavior occurs at a rate 
low enough to be counted reliably, and when it is easy to pinpoint the 
beginning and ending of each Ipehavior. Frequency count systems require 
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that someone (teacher, aide, student observer) keep continuous attention 
on the target student(s) during the specified block of time. Ingenious 
teachers have learned to deposit tokens in cups, tear notches in a 
card tied on a string around his/her neck, hand out raffle tokens, use 
golf counters, or make marks on a masking tape bracelet to increase 
mobility during observation periods. If frequency count systems are 
kept simple, multiple behaviors for one child can be recorded (Figure 18) , 
the same behavior for several children can be tallied (Figure ]9) 9 and 
one to three behaviors for a whole class of students can be compiled 
as in the example in Figure 20 designed for an aide to watch during 
the seatwork period. 

Effective Discussion Skills 

Student : 

Skill: 

Date: Time t0 (total* min.) 



Raises hand 


Makes appropriate 


Looks toward 


to ask questions 


class contribution 


speaking classmate 


/// 


// 


JMf JSfT 



Fig. 18. Recording Several Behaviors for One Student 



Asking for Game Card in Turn 
Task: 

Date : Time to ( min . ) 



Tom 


Eve 


Kent 


Amy . 


Sally 


Ben 


SHf 


//// 


// 


SHI 


//// 


SH7 



Fig. 19. ' Recording One Behavior for Several Students 
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Date: 




Activity: 


(seatwork) 




Time: 


to 


( minO 




Sam 


Amanda 


Pete 


Leon 


Ruth 


Kelly 


X X 


X O X 


o / 


x / 




o 


Tom 


Eve 


Kent 


Amy 


Sally 


Ben 




X X 


X X 




/.//// 




Lori 


Janet 


Al 


Molly 


Mary . 


Beth 


o X 


X X 


X X 






/ 


Hank 


Betty 


Lennie 


Luke 


Mark 


Debbie 


/ / 




/ o 




o o 





Fig. 20 Group Recording Using 
a Room Seating Chart 



Code 

x talks out 

o gets out of seat 

/ asks for help 



Frequency data is usually graphed either in raw total, e.g., 
total number of fights in a day, rate of behavior. To figure the 
rate of behavior, use this formula: 



rate = frequency of behavior i.e., 5 behaviors = 2 5 
units of time 20 minutes per' mi n 



Rate provides an index score which can be .used comparatively even 
though lengths of observation vary. In Figure 20 example, Sally's 
rate of asking questions for help would be 1.0 for 5 minutes or .25 
for 20 minutes. Rates ce ~ be graphed in the same manner as raw 
frequency data are, if the vertical axis is labeled frequency per 
unit of time as in Figure 21_. Graphed data is usually given the 
"eyeball" test to decide: a) if change has occurred, and b) if 



it 
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that change appears to relate to interventions. 
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Fig. 21 Rate of Asking For Help 



There are times when change is occurring so rapidly that the 
teacher will want the dai ly frequency data graphed; but at other 
times a general pattern of change may be made more evident by graph- 
ing grouped data. Data totaled or averaged, on a weekly basis for 
example, would be less sensitive to daily fluctuations. After 
graphing the grouped data, trend lines can be drawn and compared to 
see if there is a probable change due to the program intervention as 
seen in Figure _22. Trend lines are done by drawing a best guess 
line that is straight but passes §s close to each data point as 
possible of the before section of the graph- This trend line is 



" t h en extem ted into the after region of the graph and compared to the 

3 

actual after data, points. 



For more information on this approach, see Fitz-Gibbon & Morris, 

Fitz-Gibbon, C. and Morris, L. How to Design a Program 
Evaluation. Beverly Hills: Sage Publications, 1978. 
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BEFORE 



AFTER 




+-U — i — i — 



token system started 

best guess trend line of 
outcome had there been no 
token system intervention 



probable reduction 
due to intervention 



12345678 



Fig. 22 Use of Trend Line Projection to 

Evaluate Change in Frequency Data 



Example 2. Token Economy System Data 

A variation of point systems is a token economy in which stu- 
dents who display desired behaviors receive points or tokens to be 
cashed in for privileges. Token economies are systematically de- 
signed and carried out, making them logical methods to generate data 
useful in evaluating student progress. All too often, however, 
teachers do an excellent job in running a token economy program, but 
fail to systematically record and use its data. 

There is a basic difference in the way data is generated in 
token economies compared to frequency counts of behavior. The differ- 
ence is caused by logistical factors, because in the token economy 
several behaviors are focused on simultaneously for groups of students. 
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In token economies, points are allowed for displaying chunks of be- 
havior over longer periods of time rather than for each individual 
behavior. Practically speaking, the points are given according to 
teacher ratings of a) whether or not the desired behavior was dis- 
played and b) the degree to which the teacher judged the behavior 
to be adequate. 

Many BD teachers have designed point cards for students similar 
to the one seen in Figure 23. The card is a simple collection device 
to record points over time until sufficient numbers are earned and 
converted into reinforcement activities. By listing what the points 
were used for, it also provides a record of reinforcers. 



Narre Kent Date 10/18/81 








Stays 
in Area 


Works 
Quietly 


Asks 
for Help 


Completes 
Work 


9:00-9:15 


X 


X 


X 


X 


^: 15-9: 30 


X 




X 




10:00-10:1! 






X 


X 


10: 15-10 :3( 


X 


X 




X 


12:00-12:15 






X 




Totals 


3 


* 2 


4 


' 3 


Carry-Over Earned Today * Used Today Carry-Forward 

10 12 - - 20 +2 

for 



Fig. 23 Sample Point Card 
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Periodically, the teacher charts points on a progress graph 
which provides students with a visual display of progress and helps 
teachers see trends, progress and need for program changes. Teach- 
ers should also file the cards for <ater use descriptively, as 
student progress can always be documented later from this new data. 
There is no one best way to compile such data, but a first strategy 
is to look at the student's objectives and fit some characteristic of 
the data to the objectives . The same data characteristic does not 
need to be used indefinitely—the graphing process should be short- 
term and flexible to meet specific purposes. Two examples are provid- 
ed in Figures 2^ and 25 of the types of graphing possible from the 
data gathered over time from the point card to the illustration, 
(See page 59.) 

One system for student communication and feedback with students 
in comprehensive BD programs is the STAR sheet, an adaptable form with 
space for rating social behavior and academic work of each student on 
0-4 point scales in each class or major activity period of the day, 
(See page 60.) The report sheet can be modified to reflect the needs 
of particular students in particular settings; target behaviors can be 
specified by different teachers and adapted as the student progresses. 
A language arts teacher may require a student to listen cooperatively 
to others and participate in discussions in order to receive a "good" 
rating, while the BD teacher expects the student to show self-control 
and independent work habits to earn a "good" or "excellent". The form 
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Good work skills 
Completes work 



MT WThF M T W Th F 



Oct. 1 

Days 

Fig. ,24 Seatwork Behavior 
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Fig. 25 Good Worker Points 
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Fig. 26 STAR-Sheet Form 



ERIC 



-60- 



<> 0 



can be tailor-made for younger children with behaviors spelled out 
on the sheet for checking, as 



listens to 


begins 


works 


finishes 


directions 


task 


by self 


task 



The important requirement is that teachers clarify for students pre- 
cisely what is meant by "unacceptable' 1 , "poor", "average", "good", and 
"excellent". The comment section of the form should be used to clarify 
the reasons for the rating in as positive a manner as possible. 

In a typical STAR sheet system, each student carries, the form from 
class to class and is responsible for getting teacher ratings at the 
end of each class. This provides direct, immediate communication with 
the student about his/her behavior. This communication process is 
completed by having the parent review and make positive comments about 
the ratings at night, and by having the student return the form to the 
BD teacher the next day. It takes only about ten to fifteen minutes a 
day for the teacher to transfer points to a data sheet, which can be 
designed similar to Figure 2!7. At the end of each week, all points 
can be totaled for use in a reinforcement system and behavior can be 
averaged and graphed in various ways. (See page 62.) 

As time goes by, some students can shift away from using the 
STAR sheet as an external control system, into using it as a self-man- 
agement procedure. Since the entire system and format are so flexible, 
a STAR program can be used as the basic data-generating device in a 
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Positive Points 
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TOTAL 



T. T. 



T. 



Fig. 27 Data Transfer Sheet 



program and carried on indefinitely. Since behavior ratings are contin- 
ually redefined as time goes by, the data should not be considered as 
absolute. In general, the data does reflect a student 1 s progress and 
adjustment. When STAR sheets are kept on file over the course of a 
semester or year, the teacher is able to reconstruct any phase of the 
child's program, using data as documentation and linking progress to 
interventions and significant events. An interesting' way , to graph STAR 
sheet data is to separately average behavior ratings in the major prog- 
ram components, such as mainstream classes and BD program classes. By 
graphing component averages on the same graph, comparisons of relative 
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Resource Action Program 
I 




2 4 6 8 10 12 14 16 18 20 22 24 2 4 6 8 

Weeks Cycle . 

Tri One Tri Two Tri Three t 

Weekly Behavior Rating Average 



Junior High Classes- 



RAP Classes . 



Fig. 28 Weekly Behavior Rating Average 
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progress are easily discernible as seen in Figure 28 . 

Example 3. Self-Monitoring Procedures 

There are many simple ways students can observe and record their 
own behavior. In addition to the therapeutic benefits for students 
when they are more aware and responsible for their own conduct, the 
data can be used by teachers to supplement their own observations as 
"indicators of progress". Teachers save time and increase flexibil- 
ity when students carry out the data-recording process independently. 
Another advantage in using this approach is that self-recording may be 
the only way to get measures of a student's thinking or feeling states 
which cannot be directly observed. Thus, these procedures are frequent- 
ly used for recording thoughts , such as angry thoughts about a person 
or self-encouraging thoughts, and for recording feelings, such as crav- 
ings for foods or panic states. It is not necessary that target be- 
haviors, thoughts or feelings occur frequently; this technique is use- 
ful for charting low frequency behaviors which would require the 
teacher to observe continuously over a long period of time in order to 
note it. 

There is a disadvantage, however. Data students keep on them- 
selves may not be totally accurate. There are ways to reduce this 
problem. First, the student needs to be properly motivated and invested 

4 For additional "how-to" materials on the STAR sheet system, 
contact Al Marshall Child Psychiatry Service, 
500 Newton Rd., Iowa City, Iowa 52242. 
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in using self-monitoring procedures. Secondly, the teacher must 
teach the student the procedure. Third, after turning the data record 
ing over to the student, the teacher needs to periodically check the 
student's accuracy and discuss any differences with the student. 
Fourth, if reinforcement contingencies are linked to the self-monitor- 
ing procedure, it is sometimes possible to reward "good self-recording 
as opposed to basing the reward on frequencies or ratings of the tar- 
get behavior. This makes it easier for the student to be honest. 
When this is not possible, the teacher might offer a bonus reinforce- 
ment when self-ratings agree with the teacher's ratings. 

Students typically use one of two forms of self-monitoring: rat- 
ing own behavior or doing frequency counts. When doing frequency 
counts , both student and teacher agree on, a clear definition of what 
a whole behavior is— the cycle from start to end. When doing ratings , 
both must understand and agree on the qualitative standards for judg- 
ing the behavior. Actual recording devices can vary: point cards, 
masking tape, wristbands, golf counters, and stopwatches are all easy 
for youngsters to use. Data from these collection devices can be 
graphed, charted, or filed for use in measuring progress on student 
objectives. 

One ingenious self-recording device is called a countoon and 
described by Kunzlemann. 5 A countoon is a "cartoon that counts" and 

5 Kunzlemann, H,, Cohen, M. , Hulten., Martin, G. , and Mingo, A. 

Precision Teaching . Seattle: Special Child Publications, 
1970, 106-131. 
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is drawn with stick figures to portray a child's behavior cycle. A 
complete countoon is drawn with three basic components illustrated: 

1. A picture sequence illustrating What I do; 

2. A numerical grid to record My count ; 

3. A picture illustrating a What happens outcome. 

The following example is a countoon for a student recording success- 
ful use of the Turtle technique (as described previously in Analogue 
Observation - Example 1), This countoon is set up for a week's use 
with the reinforcement system being free time in the gym. 





WHAT I DO 


MiT COUNT 


WHAT HAPPENED 








12 3 4 
5 6 7 8 
9 10 11 12 
13 14 15 16 


C 
I 


^® ¥ 

^ hSm'tn. 



Fig. 29 Countoon Self-Monitoring Procedure for Turtle Technique 

In the following example, the BD student used a point card for 
making self-ratings in both academics and behavioral areas. During 
the early stages of the program, the point card was folded in half 
to clearly separate assignment completion from behavior ratings. 
Both student and teacher completed the card until the student could 
make valid judgments of his/her own behavior. Later, the point cards 
were modified in a number of ways—more behaviors w*re added, the 
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time units were increased, and the student completed the self-monit- 
oring independently. The example in Figure 30 is a sample of an 
early phase point card; Figure 31. shows just the right hand portion 
of a point card used in the final phase. 6 

The data resulting from this series of point cards were very 
useful for documenting the student's ability to meet increased behav- 
ioral expectations. There are many different types of objectives 
which could be documented by the data in this example, including but 
limited- to the following: 

increasing work completion rate 

increasing percent of time the student works hard 

increasing percent of time the student keeps hands to self 

applying self-monitoring procedures to new target behaviors 

lengthening the period of time student can maintain own 
behavior by self-monitoring without needing teacher checks 
for reinforcement 



jnonitoring own behavior with high agreement level with 

teacher as program fades from joint to independent self-ratings 

transferring the learned self-monitoring skills to a new type 
of class (social skills group class) 




maintaining levels of positive behaviors when reinforcement 
schedule shifted to weekly rather than daily basis. 



6 



Green, M. Systematic use of student-monitoring procedures 
to measure progress on -IEP objectives. Unpublished 
paper, Child Psychiatry Service, 1981. 
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Date \JjC*J*jl^ 



Academic Assignments 
x = conplete 



Reading 9:00 - 9:45 

New Story! pp. 43-48 y 
Workpages - p. 11 ^ 
p. 12 ^ 
p. 13 — 
Word cards with partner 

Spelling 9:45 - 10:00 

Copy word list ^/ 
Choose 5 words to use 
in sentence *S 

Math 10:00 - 10:40 

Play "I win M subtraction 
with Terry & Ann 
Worksheet (+ and -) 



How many ccnpleted assignments? 



7 



Behavior 1 . 

Tasks. 2. 
o = yes x = no 3. 



Hard work 
Hands to self 
Nice talk 



9:00 - 9:15 
9:15 - 9:30 
9:30 - 9:45 



10:00 - 10:15 
10:15 - 10:30 
10:30 - 10:40 



8 



€> 



9:45 - 10:00 Q (£> (T) 



3 
3 



How many behavior tasks done? / fp 



Fig. 30 Beginning Phase of a Self-Monitoring Procedure 



Behavior Tasks 

o = yes 
x = no 



9:00 - 9:45 
*9:45 - 10:00 
*10:00 - 10:40 

10:40 - 11:00 
*11:00 - 11:30 



1. Hard work 

2. Neat work 

3. Accurate work 

4. Good listening 

*5. Trying something new 



Reading 
Spelling 
Math • 
Writing 
Social Skills 




How many behavior tasks done? 



n 



Fig. 31 Final Phase of a 

Self-Monitoring Procedure 
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It should.be clear that there is a great deal of potential in using 
simple self-ratings in documenting progress on student objectives if 
the teacher is creative and organized! 

2. Systematic Observation Procedures . Systematic observation 
procedures have been highly recommended during the last decade for 
the measurement of behavior in naturalistic settings. While many of 
the proposed observation systems have worked well for consultants and 
psychologists who do not have to teach and observe simultaneously, 
teachers have found it more difficult to implement these methods. 
Recognizing these procedures may be beyond what a teacher can do 
while teaching a class of youngsters, this author hopes that BD teach- 
ers will become h,jre familiar with the techniques and their benefits, 
and that they will create opportunities to try systematic observations 
to the extent possible. 

There have been other examples of observation methods described 
in this chapter: 1) the check-charting process used with the VORT 
Behavioral Characteristics Progression, 2) the use of delayed ob- 
servation questionnaires with analogue observations, and 3) various 
examples of frequency counts. These certainly can be "systematic", 
but, what is referred to in this section are observation procedures in- 
volving the use of a code for describing behavior and the recording 
of behavior in short interval s of time within completely natural sit- 
uations. Many BD professionals believe that systematic observation is 
the best way to gather unbiased information—a code controls what we 



look for and how we label it, and the time-sampling procedure of cod- 
ing within pre-set intervals controls how our attention is focused. 
Frank Wood has written that "observation systems are the spectacles 
which help us see better how others are behaving", and this analogy 
serves to remind us that our own professional orientations do in- 
fluence our describing, measuring, and judging of student progress.^ 

Systematic observation procedures generally require that the 
observer pay total attention to the situation. These observations can 
be used while aides teach, by aides while teachers teach, during inde- 
pendent work periods, or in mainstream classes while the BD teacher ob- 
8 

serves. Kubany has suggested that teachers can implement time-sam- 
pling observation by setting a kitchen timer to go off on 4, 8, or 16- 
minute intervals. When the bell rings, it signals the teacher to code 
behavior, reset the timer, and continue teaching. The feasibility of 
this kitchen timer method seems questionable--i t may be very disruptive 
and cue students to change their behavior "at the bell". 

There are a number of different ways systematic classroom obser- 
vations can be conducted. Many are quite easy to do once demonstrated 
and practiced. Consultants or psychologists may be available to help 

^Wood, F. and Brazil, N. Looking for the good and bad in "prob- 
lem" children. Unpublished paper, University of Minnesota, 
1979. 

o 

Kubany, E. and Sloggett, B. Coding orocedures for teachers. 
Journal of Applied Behavior Analysis , 1973, 6_ (2), 339-344. 
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the teacher set up and try out a simple system. Even with help, the 
BD teacher needs to progress through a logical sequence of steps in 
implementing an observation procedure. 

Step 1: Decide who to observe . 

a) The single target child may be the sole focus of the obser- 
vation if only his/her behavior is of interest for the purpose of 
the observation. This might be true when a teacher is measuring prog 
ress on IEP objectives without wanting comparative data on other 
students in the class. 

b) Sometimes one or two cohorts (other students) are observed 
simultaneously with the target child. In this case, cohorts may be .. 
selected to represent the range of acceptable behavior in the class 
by having the teacher identify a "good" peer and the minimally ac- 
ceptable "poor" peer. Information on all three children helps the 
teacher interpret the adequacy level of the target child's behavior. 

c) The behavior of the entire peer group can also be sampled by 
sequentially coding peer behavior in alternate intervals with the 
target child. Thus, on a 5-second interval system, the sequence for 
observation would be: 



5-sec. 


5-sec. 


5-sec. 


5-sec. 


5-sec. 


5-sec. 


5-sec. 


target 
child 


peer #1 


target 
child 


peer #2 


target 
child 


peer #3 


etc. 
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At the end of the observation, half the data will be on the target 
child, and the other half on the "composite peer". Peer data can 
help teachers interpret the severity of the behavior of the target 
child. Peer data can also be used to establish what the "norm" of 
behavior is in a particular class at a given time. The norm level 
can then be considered when specifying the criterion for desired 
change in a student's IEP objective. It does not make sense, for 
example, to expect the BD child to be on-task 90% of the time if the 
average level in his/her regular class is 75%, and that level is ac-. 
ceptable to the general education teacher. 



Step 2: Develop or select an observation code . 

a) Specific behaviors may be targeted to measure objectives 
unique to different students. Teachers often are interested in 
tracking a few specific behaviors, such as temper tantrums or social 
initiations. Each behavior can be coded simply as "+" it occurred 
or "-" it. didn't. 

b) More comprehensive codes are usually used in systematic 
observations, whereby a pre-defined code is used for all students 
consistently. When using such a code, the observer is limited to the 
behavior variables defined in the code and must "fit" the student's 
behavior into one of the available categories. There are over two 
hundred codes described in the literature, and teachers can easily 
adapt a number of codes for their own use. The simple codes in 



9 
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Examples 1 and 2 would be good starting codes until the teacher has a 
better idea of the categories of behavior he/she wants to focus upon. 
There are many advantages to using comprehensive codes--they are 
standardized and can be used to gather data for comparisons across 
students, situations, and time. 

Step 3: Select the situations you want to observe. 

a) For the purpose of getting a representative sample of behav- 
ior, a variety of situations must be observed. At a minimum, these 
should include a seatwork period, a small group academic class, a 
large group class, and a relatively less structured situation such 

as lunch, recess, or free time. 

b) For the purpose of monitoring a student in specific situa- 
tions relating to IEP objectives, the most problematic period of the 
day can be observed. It is not necessary that long or daily obser- 
vations be made, but that those critical periods be observed on a 
sampling basis, such as one ten minute session on a different day 
each week. 

Step 4: Determine the length of time for each interval of observation . 

a) Most systematic codes use a 6-second or 10-second interval 
for observing and recording. This may "seem to be an extremely short 
time interval. It is better, though, to use as short an interval as 
possible; the longer the time interval , the more likely it is that 



multiple behaviors will occur. When multiple behaviors occur, the 
teacher is forced to pick the "one most salient 1 ' for coding, or the 
one. occurring at the end of the time interval. 

b) Some method must be found to keep track of intervals of 
time. There is a "beeper" clipboard sold which is useful for timing 
and cueing the observer. It is possible for teachers to make their 
own "beeper" tape by sitting down with a buzzer or bell, a stopwatch, 
and a tape recorder. The tape can then be used during observations 
with a tape recorder and earphone. Also, an observer can pretty well 
time intervals mentally by learning to tap his/her toes six times, 
which is roughly equal, to 6-seconds during an observation. Whatever 
method is used for timing intervals, all that is important is that the 
intervals be equal and systematic. Otherwise, the observer will code 
capriciously whatever catches his/her eye from moment-to-moment . 

Step 5: Make a data recording sheet . 

a) The teacher needs to prepare a paper-pencil form with boxes 
in which to write code symbols or tally*marks (Example 1), or with . 
code symbols arranged in rows or columns for circling (Example 2). 
Because compiling data can become time-consuming, a simple procedure 
for totaling columns or rows of data should be built into the form. 

b) If a school system uses systematic observation on a broad 
scale, a computer scan sheet form can be prepared which has the com- 
puter score the observation. 
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Step 6: Ma.ke a chart or graph for displaying your findings . 
* • 

a) Data needs to be summarized in manner that is easy to understand. 

Typically, the percent of each behavior during the observation is com- 
puted and then graphed, or tabled so that relative differences among the 
behaviors are evident. If cohort or peer data have been collected, it 
is illustrative to include this information in the frequency table or graph 

b) Data can also be graphed over time. Whichever behavior is being 
focused on in the objective can be used for monitoring by graphing its 
percentage. For example, the percentages of time the student displays 
out-of-seat behavior may be graphed on one form for each of the ten 
observations . 

Example 1. Walker Classroom Observation System. 



Description: This simple code described by Walker 9 includes the 
following code variables: 

Child Variables: + Appropriate 

- Inappropriate 
Teacher Consequences: 0 Praise 

/ Disapproving 

The observer can record the data on a simple grid or graph paper 
where each square represents a 10-second interval, as such: 









+■ 
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+ 
















+ 




4- 
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The code symbols stand for the child's behavior in each interval of time 
and the teacher's consequating behavior whenver it occurs. By counting 



Walker, H. and Hops, H. Use of normative peer data as a standard 
for evaluating classroom treatment effects. Journal of Appl ied 
Behavior Analysis , 1976, 9, (2), 159-168. 
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the frequency of each symbol and- dividing by the total number of obser- 
vation intervals, the rates of occurrence for child behaviors and teacher 
consequences can be determined. In other words, the data would provide; 
percentages of time the target student is behaving appropriately and 
inappropriately, and the percentages of time the student received teacher 
praise, disapproval, or no teacher feedback. 

Since this code is too general to be able to track specific behaviors, 
its usefulness for measuring progress on objectives is limited. It would, 
however, be possible to compare the consistency of a child's behavior in 
different settings or to show the effect of teacher approval and dis- 
approval rates on behavior with this code. 

Modification : A data recording form can be designed as shown in 
Figure 3£ to make it possible to code one or more peers in addition to 
the target student on the same form. The observer simply alternates 
observation intervals, e.g. target - peer #1 - target - peer #2 - etc. 



Teacher 



Date_ 
In 



Page_ 



Out 



# Peers 



Zlass 'Activity 



Child Variables: + Appropriate Interval Lengt h 10 sec. Garments: 

- Inappropriate 

Teacher Consequences: 0 Praise 

/ Disapproving 



Peer 



INTERVAL 
T P 



20 



20 



Target 
Peer 



I 



40 



40 



rargec ; j j 



Fig. 3? Modified Walker Data Recording Form 



60 



60 
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The child's data is then analyzed separately from that of the peers 
and tabled or graphed for easy comparison. 



Example 2. Madsen and Madsen Code with 
Walker Alternating Peer System . 

Description : A code offering more information about off-task 
behavior was developed by Madsen and Madsen . The code includes 
the following variables: 



(+)0n-Task 



(N)Noise Off-Task 



(M)Major Motor 
Off-Task 



(m)Minor Motor 
Off-Task 



(P)Passive 
Off-Task 

(VI) and '(V2) 
Variables 



Includes all forms of verbal and motor be- 
havior that follow the classroom rules and 
are appropriate to the learning situation 
as defined by the teacher. 
Includes: a) verbal noise that breaks 
class rules and/pr interrupts the learning 
situation, and b) object noise when such 
appears intentionally or repetitively while 

s tuden t is off- task. '_ 

Gross motor behaviors involving: aj^ total 
body (out of seat, leaning across aisle, 
etc.) or b) aggressive behaviors (hitting, 
kicking, etc.). 

Motor behaviors with parts of the body when 
student is'also off-task (thumbsucking,. 
playing with academic materials); this does 
not apply when student is basically on-task 
even though there is incidental movement. 
Covers time when student is clearly not 
focused on the activity at hand, yet is pas- 
sive (watching peers, daydreaming, etc.). 
These are open variables which can be used 
to code special behaviors of interest for 
different students; these variables must be 
defined by- the teacher and can include pos- 
itive behaviors for tracking (social init- 
iation to peer, quiet sitting) or negative 
behaviors (swearing, aggressive actions, 
etc.). 



The flexibility of this code, provided by the additional open var- 
iables, allows teachers to measure levels of specific behaviors of con- 
cern while getting an overall picture of behavior. 
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The form included in this section (see Figure 33) allow teachers 
to gather data on alternating intervals for the target child and 
peer group. Data for the target student are recorded on the left side 
of the page; peer data are recorded on the right side. The totals for 
each t/pe of behavior are derived by counting down the columns; per- 
centages are computed by dividing each total by the number of intervals 
observed. For example, if the target student was coded as (N) noise 
off-tas*k five tines out of twenty-five intervals, the percentage would 
equal 20% - 

Many teachers are more comfortable coding with a 10-second time 
interval than a 6-second interval. The 10-second rate provides suffi- 
cient time to glance at the student or peer, make a coding judgment, mark 
the recording form, and be ready to shift attention to the next student 
at the beginning of the next interval. 

. Modification : The recording form can be used as modified (see 
page 79) to make it possible to code one or more peers in addition to 
the target student on the same form. The observer simply alternates 
observation intervals, e.g., target child - peer #1 - target child - 
peer #2 - etc. The target child's data is then analyzed separately 
from that -if the peers and tabled or graphed for easy comparison. 

Source : Walker, H. The Acting Out Child . Boston: Allyn 
and Bacon, 1978, 53-78. 
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Fig. 33 Madsen and Madsen Code/Walker System Coding Form 
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Observation data needs to be compiled for each behavior sepa- 
rately for the target student and peers, and compared by means of a 
frequency table or graph. Sample forms are included for these pur- 
poses (see Figure 34 ). since much information is provided by -the 
specificity of this code, the teacher can precisely document student 
progress . 



Source : Walker, H. and Mops, H. Use of normative peer data 
as a standard for evaluating classroom treatment 
effects. Journal of Applied B ehavior Analysis, 1976, 
9 (2), 159-168. 

Becker, W. , Madsen, C, Arnold, C. , and Thomas, D. 
The contingent use of teacher attention and praise in 
reducing classroom behavioral problems. Journal of 
Special Education , 1967, 1_ (3), 287-307. 
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Fig. 34 Observation Data Summary Sheet 
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